Self-aware Object Tracking in Multi-Camera Networks

This chapter discusses another example of self-aware and self-expressive systems: a multi-camera network for object tracking. It provides a detailed description of how the concepts of self-awareness and self-expression can be implemented in a real network of smart cameras. In contrast to traditional cameras, smart cameras are able to perform image analysis on-board and collaborate with other cameras in order to analyse the dynamic behaviour of objects in partly unknown environments. Self-aware and self-expressive smart cameras are even able to reason about their current state and to adapt their algorithms in response to changes in their environment and the network. Self-awareness and self-expression allow them to manage the trade-off among performance, flexibility, resources and reliability during runtime. Due to the uncertainties and dynamics in the network a fixed configuration of the cameras is infeasible. We adopt the concepts of self-awareness and self-expression for autonomous monitoring of the state and progress of each camera in the network and adapt its behaviour to changing conditions. In this chapter we focus on describing the building blocks for self-aware camera networks and demonstrate the key characteristics in a multi-camera object tracking application both in simulation and in a real camera network. The proposed application implements the goal sharing Lukas Esterle Alpen-Adria-Universität Klagenfurt, Austria, e-mail: [email protected] Jennifer Simonjan Alpen-Adria-Universität Klagenfurt, Austria, e-mail: [email protected] Georg Nebehay Austrian Institute of Technology, Austria, e-mail: [email protected] Roman Pflugfelder Austrian Institute of Technology, Austria, e-mail: [email protected] Gustavo Fernández Domı́nguez Austrian Institute of Technology, Austria, e-mail: [email protected] Bernhard Rinner Alpen-Adria-Universität Klagenfurt, Austria, e-mail: [email protected]